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ABSTRACT 


Tne work investigates the notion of separability in 


eontinuous parameter stochastic processes. It explores the 


implications of relaxing the separability hypothesis. 


Werrous numerical results are obtained for a particular 


example, the O-1l Markov process. 
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Pao ODUCT ION 


Our aim is to Meconeece peculiarities of non-separable 
mmecesses. in Chapter Ii we introduce the general notion of 
separability for abstract, continuous parameter stochastic 
processes following Doob's presentation [2]. We then 
illustrate the concept in action by studying the O-1 Markov 
process, to which Chapter III is devoted. We first define 
the class of measurable sets generated by the finite 
dimensional measures. Then, following Halmos' presentation 
of inner and outer measures and extensions [3], we extend 
Vecemeasure in a non-unique fashion to a larger class of 
sets. Rach extension specifies a particular equivalent 
Meteeton Of our process, the separable case being one of the 
eeelection. Learning that certain constraints were involved, 
we derive a functional equation later in the chapter, and 
such a functional equation summarizes all the constraints. 
We then place the non~-separable case under a new light 
through the use oP a "factor function" which we relate to 
the probabilities within the non-separable process. From 
this new mentee point we were able to prove that at a 
particular parameter value either all or none of the sample 
paths are continuous. We conclude our work with suggestions 


Perm iurther study. 





ioe ane ot ry 


In this section we wish to present the concept of 
separability in stochastic processes that have a continuous 
fieeemecler set. AS Will be seen, such processes deal with 
waemconav are not measurable unless certain conditions are 
placed on the process. The concept of separability gives 
the required conditions enabling such sets to be measurable. 
mepctruliy, this section will make clear the concept of 
mem@arability, as well as the problem we wish to present. 

Let {X, ,teT} be a stochastic process with parameter 
set T which is any interval of the real line. The random 
Variables X, are Cetineee otra Sel (lee of denote a class 
Sic Osea sets. Then the process is said to be separable 
Geeaolve to cA if there exists a sequence of parameter 
values {t,} and a subset A of Q of probability .zero such 
eat for Ac cA and any open interval If in ,T, the w-sets 

{x,(w)eA, tel} (x, (w)eA,t eT} 
J 
differ by at most a subset of A. We will use the term 
"a separable process", acknowledging that it is with respect 
to cA since the context is clear. Also we will call any 
sequence Oe! satisfying the conditions of the separability 


definition, a separability set. 





Except in pathological cases the separability set {t} 
memcense in Tt. If we enlarge our separability set by adding 
eevunvavple number of other parameter values, the new 
sequence {t,} tooo wo separability seu. since {tJe{t, Jet. 
Poemversely, if any countable dense subset is a separability 
pee, we say the process is well—-separable. 

#6 was worth questioning whether we could restrict our- 
Serves tO open intervals te Wit Ne ravmomale fOr Antiini te), 
ememoints, and still satisfy the separability definition. 
The question proves to be true. Consider an interval (a,b) 
where a and b ane Siapaioael, Let aya and bts where 


the a_'s and b's are all rational. We observe that for 


n>m, and any AcdA, 


ile ha cima oe el aay pace ba 


and show that 


M= {x 


- (w)eA,t,e(a,b)} = A Mn 


J 


foe] oO 

Certainly Mf] M.. So take an we f| M.. If wkM, then there 
n=1 a 

is a t,e(a,b) such that xp (w)¢A. But there exists an n 


J 
such that tse(arsbo), and weM— which gives us a contradiction. 
Thus weM. Hence, M = f\ Mo Therefore in our definition 

n=l 
er separabality, it is sufficient to restrict the condition 


PemOpenieiivervals Of rabio0nal, or infinite, endpoints. 








a 





MeO ane ate tiem ewo W-SELS 1m OUr delinition of 


Peaeeordorlapy, we could express the sets in the form, 
(1) ineucCoete ten) =. (| {x, (a)eh} and 
t pew © 


@) {x 


‘ (weA,t eT} = ae 


J 
The w-set (2) is the intersection of a countable number of 
memouiraole seus, hence, the intersection is measurable. 
Though each w-set in the intersection of Equation (1) is 
measurable, this is MOmEectauMeha EO shOWetrphiau une Intversce pion 
is measurable, since the intersection is over an uncountable 
mumioet Of SECs. However, because of the separable condition, 
W-set (1) has the same probability as w-set (2). This 
piemect Of countable or uncountable operations seemed to be 
the main problem in the non-separable processes we considered; 
once we leave the countable realm, we become very dependent 
Smevhe concept of separability. 

Now consider the operations of greatest lower bound, 
calles Bnd Vea cteopeie OounG. LUD, and SUpDOSe Our process 
is separable. Choose anw not in the null set A. Then for 


a separability set {t.}, and any open interval I, we can 


J 
mc an a such that 


alll een ww), —o < a. 
oe j 


If b = glb x, @), we wish to show that a = b using the 
lk | 





separability definition. Certainly b < a. Assume bd < a, 


inen consider the w-sets, 


{x, (w)e[a,o], tel] and {x, (w)eLa,e],t,eT} 
J 


by ethe definition of separability, the two we-sets differ 
emily by a subset of A, and since » is not in the first 
w-set, but is an element of the second, w must be in A, 


meme 1s a COMmvradiction. Therefore, a = b, or, more 


specifically, glib x, Cw) = fe eh GH meroreall wey in 
tel tel j 


J 
pmoamitar fashion we could show that lub x, (w) iLbiowm a ce GT 
C tc 
tel viel j 


feoreall » b A. In particular, if w t A and if t e I, then 


I 


glib x, (w) = glb x, Cw) < x¢(w) » and 


viel j Gel 
xe(w) < lub x,(w) = lub. x, (w). Thus, 
eel one j 
3) dem sip 4 xX, (e) < xe(w)< dim iub 4, x, (wu), 
neo |t.,-t|<= j neo |t.-t|<= j 
J no J a 
Tat ae 


A classical theorem concerning separability utilizes (3), 
stating that if a process is separable, and a sequence {t 53 
satisfies (3) for every t e T, then the sequence is a 
separability set. If we place the further condition that 


if for every t e T we have 





(4) jon Tabi 36 SN oe 


f ; (convergence in probability), 
Saale 


then any countable dense subset of T is a separability set. 
Mass is true, for if we take any countable dense subset of 
leery satisfies condition (4) by hypothesis. Thus, this 
subset satisfies (3). Therefore the process is well- 


separable. 


Bhowing that glib x, (w) = glb x,(w) and 
c S 
a - jerouil 
lub x, (w) = lub x, Cw) EOmuaielel Open t vi. in) the 


separable process, we obtain another natural result: For 


w ¢ A 
C5) lim inf x, (w) = lim glb _ x, (w) 
Beoe | eee ed 
J J = 
= lim glb _ x, (w) = iim inf x, (w) 
noo |t,-t|<l eaate 
es 
and 
(6) lim sup x, (w) = lim lub x, (w) 
t,2t j noo le -t|<l 7 
J J i 
= lim lub_ x, (w) = lim sup x, (w). 
t+t 


n+o |[t-t|<l 
n 


Thus, in the separable process, lim inf x, Cw) and 
uae 


lim sup x,(w) are random variables. With this result, the 
Bae 





Eaeeabllity of events concerning limits, strong continuity, 
etc., may be expressed in terms of probabilities of lim inf's 
and lim sup's, and, hence, is determinable. 

Now there is the question Sreweervner or Nov any Stochastic 
process can be made separable, without changing the character 
fmeene DrOocess to any appreciable degree. In other words 
wemore Speaking of equivalent processes; a process tx, ,teT} 
is equivalent to the process Wise nigel )) 134 amd only if 
P{x, (w) = x, (w) J = 1, for each t ¢€ T. So restating the 
question, for each stochastic process {x, (w), teT} does 
there exist an equivalent process (x, (w) ,teT} such that the 
X-process is separable? We will show that the statement 
iomeenUe . 

As is necessary in the definition of separability, we 
must find a separability set and a null set A. Our 
Separability set will be formed by construction, and then 
from this separability set we will describe parts of our 
mime set. 

First, we show that for each closed set A, we can find 
a sequence t Uo» Mees UCh Ula & 


3b 


(7) P{x, (w)eA,n>1;x, (w)gEA} = 0 for each t e T. 
n 


Bewtake a closed set A. Now choose any finite sequence 


t, > ee eis a of parameter values. Define 


10 





Gy t = eee ; and 
Bee eine (Gs 5) 
Jee jt 


Memm@ove that for a fixed t, the fie t 
3 


sequence of sets, implying That Py 2 Po > eae EE P, = Ge 


's form a decreasing 


then we have found the desired sequence for the particular 
emosed set. If P, > OS by the detanitaenmot lub, there 

: HE 
exists a t such that P(G, 2) S p,.(4 - n> and we let 


t (modem by tnauction, we form an infinite sequence 


ktl 
ti» to. ates ae Assume that Pp), ? 0, ftopeait kk. Forxeach) t. 
we have 
(8) P{x, (w)eA,n>1;x,(w)¢A} < lim p,. 
n ko 


Consider the w-sets, 


H, = {x 


k (u)eA,n<k;x, A} 


vy kt+1 


Since the H's are Gisjoint, the probability of their union 


equals the sum of their probabilities, implying that 
= eeatie rs i 
Lim PCH, ) = 0. But by definition, PCH) > p,(1 - m3 


k->0o 


thus, limp, = 0. From cy 
ko 


P{x, (w)eA,n>1;x,(w)¢A} = 0 , for eacumt & Ts 


Nn 


1 





em@eeso we have found the desired sequence for a particular 
eeooed set A. 

Now let A, be the class of sets which are finite unions 
of emesea Intervals wath rational or infinite endpoints. 
If A is the class of sets which are intersections of se- 
mm@eneces of sets in A; then A anelua@es all the closed 
fewoe by che preceding paragraph, for each A e A. there 
corresponds a particular parameter sequence such that (7) 
is true. Since there is a countable number of closed sets 
Lidl or we let {t_ be the union of all the corresponding 
sequences. Let | 


A, (A) = {x, (w)eA,n>1;x,(w)gA} , and 


rn 


A A, (A) 


te Nh 

Ae 6 
We note that PCA, ) = 0, since there are only a countable 
number of A, (A)'s to consider, each of which has probability 
0. Now if Ae cA, ana Ave A, such that A ™ A,» then 


(9) {x, (w)eA,n>13x,(w)gA} < {x, (w)eA,n>1;x,(w) GA} = AL. 


Ba n 


ies implication then follows, since each A-set is an 
maversection of A -sets. 


Now let I be an open interval with rational or infinite 


eepornwenmwacin § = TY and then restrict our process to the 


lie 





process {x, ,teI}. For this restriction, we let 


ttt, oo lesen byseur previous results, there 


exists an w-set Ne ope such that 

P(A, = 0 ore | Sie Veigid Was elle and 

{x (w)ecA,se{t }73x, (weal < Rese for each Ac A. 
Mew 

: = rel, ee Nast rer, Ae ot where I, is 


imqewclass of all open intervals in T with rational or infinite 
emoepoints, implying I. is countable class of open intervals. 
For a fixed w, we define A(I,w) to be the closure of the 

set of values of x,(w) where s varies in I NM S. The values 

of +o may be in A(I,w). This set is closed and non-empty, 


and we note that 
x, (w)eA(T ,w) alse tel wi, . 


Defining A(t,w) = f\ A(I,w), we know that A(t,w) is closed, 
Tet 
and since we have made the class of A(I,w)'s compact by 


including the values +”, A(t,w) is non-empty. So 


x, (w)eA(t ,w) 138 teT wel, . 


us 





Ital 


tiie. We Geline our x-process by, 


ee 


vs x, Cw) Cae ce |S 
Tan (i) , 
x,(w) if teS we A, 


any value in A(t,w) 1 eS ei hale 


We now want to show that the x~-process is separable, and 
equivalent to the original x-process. Certainly 

P{x, (Cw) = X, Cw) } = 1, implying that the two processes are 
equivalent. Now let Ae cA, ana Suppose that I ¢« I. and 
w is such that X,(w) e A for all se If S. Hence, by 


fem cion A(l,w) <¢ A. So if t ¢€ 1, then by our construction 


on xX, 
X(w) = x,(w) e€ | ACI,w) @ A if teS, or t¢S,w¢A, 
A(t,w) © A(I,w) © A Af t4S,wed,- 
mas 5 | | 
(10) : (5, (w)eA,seTNS) = {X, (w)eA, tel} 


By a previous argument, we know that we can restrict the 
Gefinition of separability to open intervals with rational 
Srsinfinite endpoints. Therefore our X-process is separable, 
and thus, every stocahstic process has an equivalent, 


separable process. 


14 





It is important to note some characteristics of this 
constructed separable process before leaving this section. 
Though it may be too strong to say that the null set A of 
Mammon PCOcess 1S the vold set, it is, nonetheless, true that 


mer all open intervals I in T and A ind, the two w-sets 
({k. (w)eA,seINs} and {k, (w)eA, tel} 


differ by a void set. The construction has eliminated from 
few x=—process all sample paths, characterized by an wo, 
Mhach behave, in some sense, badly. There are possibly an 
Umcountable number of separable processes equivalent to the 
X=process, but this x-process is the best one can hope to 
have, in the sense that every sample path behaves well. 
Thus, this x-process represents one extreme of the class 

of all processes equivalent to the x-process. It is fair 
mcm co ask what process represents the other extreme. 
Beeause Of the abstractness of our sample paths, we delay 
this question until a later section, where we consider a 
particular process in which the sample paths are easier to 


Pmeceure . 


15 





ene Oa MARKOV PROCESS 


In considering the separability concept, the continuous 
parameter process we will study is the O-1 Markov process 
{x, (w),tel0,t J}, where t. < ©. In such a process, whether 
separable or not, certain finite dimensional probability 
properties are true. Define Py; (s,t) to be the transition 


eeopability; that is, 


py, (s,t) = P{x,(w) = j[x,(w)=i}, where O<s<t<t., 
ee Og. by 4 


and P{x.(w)=i}>0. 


For our process, the transition probabilities have the 
stationary property that py, (s,t) depends only on the 
Gifference t - s, and we may write the transition probability 
as py, (t-s). Further, these transition functions can be 
derived and are of the form: 
iG 


ee) = ats be | 


00 Poe = > Be 


- me . _ = 
P17 ft) =b + ae Pio ft) =a- ae 


Migete a,b > 0, anda+t+be= ii. 


16 





A. THE SEPARABLE 0-1 MARKOV PROCESS 
New leCUsUs SUDpPOSe that our process is Separable. It 
can be shown that 


P{x, (w)2i,t<t<tta|xf(w)=i} = e Ti" 


winere q. = 


We know also that each sample path in which there exists 
an instantaneous jump from one state to another has 


meeeebility 90. In particular, sample paths of the forn, 
{x, (w)=0,te[0,t];, (w)=1,te(t,t,), |x, (w)=0} 


have probability 0. However if we take the probability of 
the collection of all such sample paths (that is, the 
Peeopability of exactly one transition in the interval 
b =a =|G1E _ me 
ae OO = 5 one Ifbrar ss 
tne probability is derived by taking the limit as b and a 


Lo,t J); we obtain 


both approach %, and the probability is “te to. These 
probabilities are conditioned on the event that x, (w) = 0. 
If we condition them on the event that x (w) = 1, the 
probability of exactly one transition in the same interval 


1s a (e7P%o = S75), and again if a = b = 4%, we get 


Bt _e o . As will be seen later in this section, these 


iy a 








probabilities are bounds for the arbitrary probabilities 
that may result from the same events in the non-Separable 
processes. Other "Separable" probabilities for different 
events could aiso be calculated, but those mentioned above 


will suffice for our discussion of the non~-separable process. 


B. THE NON-SEPARABLE 0-1 MARKOV PROCESS 
ime xtension of the Measure 
The finite dimensional probabilities yield a 
measure for events involving a countable number of parameter 
Veeues. The collection of all these events will be the 
o-algebra S, with the probability measure wu. We now wish 


wemerove and apply the following extension theorem: 


Theorem: If Me S, there exists a (non-unique) 
probability measure uU, an extension of u, defined on the 


O-algebra S generated by the sets in S and the set M. 


Proof: We first show that A= {(ENM)U(FAM'):E,FeS} 
is the S-algebra S eae we are looking for in the theorem. 
simce X,¢ = 3. we have that M = (XNM)Y ConM')ecdA. Also, 
for all EeS, it follows that E = (ENM)U(ENm')eA, implying 
Tier SS A . Thus, A is in a sense generated by the sets 


in S and the set M. Now we must show that cA is a o0-algebra. 


Let A, > Ay > peas cA, implying there exist 
Ey > Ey» seein Bs Fo > és, such that 
= ’ = 
A, CE,AM)UCFLAM ye Ay (E,QM)UCFAM'), Teg a nl ets: 


18 





Eeo and UW F¢S, we have that 
n aie 9 
iL n=l 


A= CCU E MIUCC T FAM eA. also if 


i n=l n=l 


ry 
nag 


1 8g 


al 
A = (ENM)UC(FAM')e cA, then 


[CEAM)UCFAM')]' = (CE'UM')ACF'UM) = (E'NF')UCENM)UCF'NM') 


at 


(ENMUCFIN Mec. Therefore, A is a o-algebra. 
Let m, and m* denote the inner and outer measure, 
respectively, with respect to measure up. If m,(M) = a > O, 


then there exists for each n a G € S such that cs M 

u(G_) <a. Let G= UY G. Certainly GeM, 
no = eae 

eeomaee o. further, by the definition of inner measure, 


and a- L 
n 


[A 


Mec = G) = 0. Now if m*(M) = b > 0, in a similar fashion 


we can find a sequence of H's imo o suen tnat if H= —{ Ho 


n=l 


then M@ H, and my(H - M) = 0. Thus, we have found 

G,H ¢ S such that GoaM ¢H and yp(G) = m,(M) and m*(M) = u(H). 
Now let D =H | G', and let A = (ENM)U(FNM') ec. 

Then AND! = (EAMAD' )UCFAM'ND') = (ENG) UCFNH') eS. Thus, 

for all A cd » AN D' ¢€ S. We may rewrite m,(M-G) = m, (DAM) 

and my(H-M) = m,(DAM'). So 


m* (DAM) 


m*(DNM) + my(DAM') = p(D) = m*(DAM') + m,y(DNM) 


m*(DAM'). 


Let i = (E,AM)UCF LAM") and A, 


A,» Ay eA. Suppose A,ND = AND. Then it must follow that 


= (E,AM)UCFAAM'), with 


(E,NMAD) = (E,IMAD) and (F,NM'ND) = (FNM D). If (E,ND) 


and (END) disagree, then their symmetric difference, 


1) 





(E,AD)ACEND) , is a subset of M'. Thus, 
(E,AD)ACE,ND)EDAM'. Hence, u(C(E,AD)ACE,ND))<my (MND) = 0. 
Therefore, uCE,AD) = U(END). In the same fashion we can 


show that uCF IAD) = u(F ND). 


Now we define our extended measure fi on the O-algebra 
A. Let o,8 > 0, with a + 6=1. Then for 


A = (ENM)U(FNM') eA, fi is defined by, 


HC CEAM)UCFAM')) = uCLCEAM)UCFAM')IAD') + apCEfD) 


+ BuC PND) . 


By the preceding paragraph, such a measure is well-defined, 


and certainly for all AeA, jfi(A) > 0. If A= $, then 


UCL COAM)UCOAM') JAD') + au(oND) + Bul oND) 


uC) 


i 
© 


u(o) + an(d) + Budo) 


Now let tA, t be a disjoint sequence in cA , where 


ie = (EAM) CRAM"). Then, 


20 





HCW A = Ce Ue ia a 


eee >) 
n=1 n=1 2 


al 
= (CCU EAM)UC URAM')IND') + au U_E,ND) 
n=] acai n=] 


co 


+ BuC U FAD) 


n=1 
= ul U [(E AMAD')UCF AM'AD') J) + f an(E MD) 
n=1 n=1 
+ fF Bu(F AD) 
n=l] 
= Y (plCCE.AM)UCF_AM'))AD']) + = ap(END) 
n=l a a n=1 is 


eee Bu(F AD) 
n=1 


= © (ul((EAM)UCF AM!) )ND'T + oy(E ND) 
n=l] 


+ Bu(F AD) ) 


Thus, w is a measure on A. Further, since 

CENM)UCENM') = Ee 8S, 

i(E) = u(END') + (at8)(u(END) = y(END') + w(END) = u(E). 
Hence, fi = p on S. Also, since | 

i(M) = y(MAD') + ap(D) = u(G) + ap(HAG') = py(M) + ap(HAG'). 
If a = 1, then ii(M) = p(G) + pCHAG') = ywCH) = p*(M). 
Therefore, p,(M) < fi(M) < w*(M), depending on a (and 8). 


setting S = cA, we have proved the theorem. 


el 





Now suppose we have a countable sequence of sets, 


M., M MeEenouciniy ow. Let SM ) be the extended 


iz 2° 
O-algebra, S 


n+l 


nt]? Bediemaveduby the Sevs an the 6 -algebra Sn 


ee@emcthne sev M tie rohlows that, 


+1° 


ep) 
() 
( 
tt 


S(M, ) GS, = S, (M,) = 


co 


Let + U Sa: If A and B are in 4 > then there 
n=l 


exist a j and k such that A ¢€ =F and B ¢€ Sie Without loss 


peeeetmcrality, we can assume j > k. Then B ¢€ ea Thus , 


I 


AUBeS © T. Certainly if Ce 4, then Ce Specie ec 


Pmiying that C' e 8, ¢ 4 : Therefore, + is an algebra. 


Je 
The measure we apply to + is He defined by 


H(A) = Hy), CA) where Ace S and My is the measure 


Vee 


On Spe 


We now apply the Caratheodory Extension Theorem: 


Theorem: Let wp be a measure on an algebra @, and 
wk the outer measure induced by up. Then the restriction 
uw of u* to the p*-measurable sets is an extension of u to a 
o-algebra containing @. If wis finite, sois pu. If u 
is o-finite, then p is the only measure on the smallest 


O-algebra containing @ which is an extension of is 


22 





We relate this extension by considering the M-sets 
associated with intervals in [0,t J. For any open interval, 


(r,s) where r and s are rational, we define, 


Ms (r,s) = {x, (w)=1 OrnmeG@ens)} , and 


ws (My ¢pis)!¥ and s are rational} 


Defining M], similarly, we let M = mM, UM, . 

Let S be the o-algebra of all sets which are 
measurable by our finite dimensional probabilities. Since 
the class7 is countable, by the two extension theorems 
above there is a o-algebra W containing’ and San tauiseethe 
N-sets are now measurable. Also this extension y has pro- 
aueed additional M-sets, namely those associated with open 
intervals with irrational endpoints, so these are also 
measurable. Such an M-set is generated by the intersection 
of a countable number 7[-sets. It is crucial to realize 
that if vn 5) 109 shell Ss) ‘pate lateral 


co 


lim M ,= fl 
no bo Sy n= 


4 


M = M ‘ Al 
1 1,(r, 5s) Nees) sist 


NE Gang ~ Ms tr.sP 


P({{x,,(w)=0}0M™ yA {x Cw)=TF IU EL x, (w)=TINM Oy 5) 


iL. (ga 


Mx. (w) =O} ULL x, (w)=x (w)=OINM, (yoy) 


= 0, by properties of the Markov process. 
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Hence, P(M = P(M ). Similarly, the same result 
iPalie.s 3 


iL, Cong 
mowobpvLained for any Mi7set. 

Let m be the measure defined on S, and m, and m* be 
feeminner and outer measure, respectively, with respect to 
-the sets in S. For any open interval I, my (My 7) = 0, 
Semiee the only set in S contained in VoL at is the void set. 


It is to be noted also that in the separable case, 


P(M = m*(M, 1D: However in the non-separable case, by 
3 


i ae 
the first extension theorem, the most we have for the 


probability of M, - is, 
1,1 


= ¥ = p 
O = mg(M, 7) < PCM) 7) <m*(M 7) = BOM, 4) 


where P denotes the probability in the separable case. 


Suppose P(M = @P(M It is easily 


1,(r,s))" 
1) = @P(M 


1, Gone 
shown that PCM) (rg) Xp) 


ie Garey) |x, (w) = ie 
Therefore, hereafter when we evaluate the probability of 
an M-set, we are evaluating the conditional probability of 


the set, conditioned on the initial value. Thus, 


rs -a,/2| pyat efi. = 0 
P(M, 1 =a 3 where qs = 
: a ari x daa le 
Also, henceforth, M Vitltepe  bne class oi alt M, I regardless 
, 3 


of the type of interval I. 
2. Inclusion of the 1-Transition Sets 
From the preceding section, we have shown that all 


sample paths which are constant (0 or 1) on an open interval 


ay 





are measurable ind, with the measure being somewhat arbitrary. 
(We will see in later sections that there are other restric- 
tions on the measure.) In this section we wish to show that 
all sample paths making one transition between parameter 
values O and we Conmecmccocriped by these W-sets, hence, 

are also measurable. 


We use the following notation: 


nl Kt 
Mo yk = {x, Cw) = QO on aa 
on : (k+1)t. 
piece = (x, (w) = | on a ae 
n n n 
Veyeee tapi 2 
MP Mg AMY ea 
n 
9n Oo =-2 k,2” 
M, = JU My 
k=1 
on 
We now show that the lim M, SxXists. “Lt lis suiiicient 
noo 
; on on oN 
memoanoew that lim M €& lim M. . Let w eé€ lim M. . ‘Then 
noo i n7o i n7oo al 
W € MS iem@esoneunwe hurler, Chere exists ann’ > n such 
t ey a t 
oH We oe ate 
Umab Ww ¢ My meethus., oO) °c M,? and w € M g for some 


k and k', with the added condition that 


k ' t+ k 
t k oe . (k 1)t. ; (k+1)¢, 


1 1 a 
2 Da a 2 





aD 





Then we can find a k such that 








= ? | : = 
kt kt. ; k A (k +1). (k+1)t | (k+1)t. 


Bt ee ee 
a a S, a sat ai 
nl ont fl nl anti 5n 
ie ntl publ on 
mis, w € M,° My Hence. by slmemey Pon. We My 
ae of 
Meet! n> n. sow ec lim M, » implying that | 
noo 
eS 9h ae oo 
lim Ms = lim My Therefore lim MS exists. 
noo noo noo 


Let A = {x, (w)=0 on. LO.) , xp(u v=) on (t,t oJ, for some t}. 
We note that A is the collection of all sample paths which 


makes only one transition to 1] in the interval [0,t J. 
n 


We now want to show that lim Me = fA. 
nro tL 


For we A and t(w), we can find a positive integer 


Meem chat for each n > N, there is a Kn satisfying 





k_ t nm (k +1)t 
no <t< n O 
De i. 
ius, WwW € My for alln >N. Hence, w e€ lim My , inp lying 
noo 
on 
tiac A = lim M. . 
1 
noo 
on 


POmew «© lam M 


ee 


1»? there is a positive integer N such 
Wmeat for each n > N, there is at least one KD such that 


we M,” . In particular we can find a sequence of M-sets, 
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nee “et —— ks 92° 
M, ad Ms > M, > ... With we My 
foreali j > N. It must follow that 
1 
ee re O oo : (kK, +1) t, q 
on <tr = ante = oe nee an 
(k t1)t. : (kg tlt, ; (k potl)t. : : Kees 
on ~ antl _ ante — 7 on 
Let 
k ¢ (k 1 
lame. = r and Hele eee ies 
n> ou n7o DNs 


Certainly r<s. If r <s, we can find ann and k~ such 


that 





r< a — < 
De re ~ 
Ke» 2 
which gives a contradiction since w ¢€ My Thuiser ——s:. 
| on 
Therefore we A, implying that lim My = A. Hence 
neo 
an 

Lim My = A. 


| Oo ae 


From this proof we know that the collection of 
l-transition sample paths in the interval [0,t J, with 


x(w) = 0, can be expressed in terms of our™-sets. We 


ell 





Semeuse the same procedure with the l-transition sample 
paths beginning with x Cw) ele 

It must be noted that it was just for convenience’ 
that we used those M-sets related to the open intervals 
with dyadic rational endpoints. We could have just as well 
chosen any other sequence of/#-sets whose respective open 
interval endpoints become dense in LO,t J. Then in the same 
fashion, express A in terms of this new sequence. Further, 


S 
afi {m0} denotes the new sequence, 


S . 
lim M." = A = lim M 
n>© n> 


S 

ipeeyvineg that the measure that is obtained by using {M,°) 
n 

is equal to the measure obtained by using (Ms }. We also 


have that 0 = mg(A) < P(A) < P(A) = 2 (e78to - e Po), 
since each of the #-sets that express A is bounded below 
mamueerand above by its separable probability. 

For k > 1, the k-transition Picea be handled 


Similarly. We will show the basic construction for the 


2-transition case. We use the following notation: 


Bes . | Jt, 
Mog =: {x, (w)=0 on ie ee 
on 2 (j+1)t. kt. 
M4 Tk = {x, (w)=1 on So ad 2 le 
on (k+1)¢. 
Meo = {x, (w)=0 on a ei da a 
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@l nN nN al 
je ae 2 2 
: =e ies “eso 
n elt gaa? Sra n 
Me UC OU geo? 


A = {x, (w)=0 on [O,t)3x (y)=1 on (t,t); 
X,(w)=O0 on (t,t J] for some t,o} 
ae 
Mewoetore, we show that lim Ms exists and equals A, which 
is the collection of all sample paths that make two transi- 
tions in the interval er eer Though we leave out the 
eee, Such a limit does exist and in fact equals A. All 
finite-transition sample paths can be expressed in a similar 
Mam@m@em, and, hence, are measurable with respect to the 
feaeure of the W-sets tiauecxpress Them, 
Bee Hrolitrary Assignment of Measures 

We have now reached the heart of our work. In 
working in the non-separable process, the probability of 
an event may be any value between the inner and outer 
Mieeoure with respect to the sets in 8, which is the o-algebra 
before we extended to include the W-sets. However, in 
assigning an arbitrary measure to a set, we have (implicitly) 
affected measures of other related sets. As an example, 


Consider the set, 


My (r,s) = 405. (yen on (r,s)} 


Ze, 





Let P(M) denote the separable probability of the set M. 
Again we are reminded that all probabilities of M-sets, 
Mereatter, are the conditional probabilities. Now suppose 
@eiemean a particular process we had that, 

) = aP(M 


P(M ) where 0 < a < l. 


Gans), ire Ss) 


Take an interval which contains (r,s), say the open interval 


< 
(c,d). Then we know that Deed) LT GoM Oye Bad 


i 


PCM a PCM) (e.ry? ao een PUMS (8,4)? 


LO, abe 
Be cen oe eee We eeceeay? 


aP(M since £6,y e« [0,1]. 


[A 


ip toned e 


Mitesweoune probabilaty of all subsets of M have been 


ieee Ss) 


affected, since in this example a < 1. Now consider a 
subinterval of (r,s), say (e,f). We have that 


= 
M1, (2,8) Mi (e,f)? and that 


&. 


POM) crys)? = PO (piey? PO ce, ry? PMG (2,8)? 


BaP (My (rey) MP CM (ory) YPM (e,8)? 


P(M 


= Ga 2a) Loe) 
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where Oy > Bs > Yy woe soo ie oonce Qs» Bs > 


and Yj cannot all be equal to 1, at least one of the supersets 


e [0,1] and a, 8 


re)? My (e,f)? My (f,s) containing seas) has a 
probability less than its separable probability, and its 


Corresponding factor, ai» BL» Or Yy> must be greater than 
Or ae wenl Co @. Thus, assigning an arbitrary measure to a 
set may or may not affect Bie probability of a superset, 
but at least one superset must have a probability less than 
its separable probability. 

Since we extended our g-algebra S to include the 
M-sets, our erate paneer in assigning probabilities should 
be with these sets. Then all other sets generated by these 
M-sets will automatically be assigned a probability. So 
we restrict our work to the M-sets hoping to discover some 
criteria for assigning probabilities in our non-separable 
process. 

From the preceding paragraph we already have two 
Conaitions: 

1) Altering the probability of a set affects the 

DLovcoimstlY “Ofwall subsevs. 
2) Altering the probability of a set affects the 
probability of at least Bite superset. 

We have another criterion which is obtained from 

the manner in which we extended our O-algebra S. Suppose 


leeey Yr and s ts. Then 
n n 


(11) lim M 


nae a abe.) . My (r,s)? 
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Wwaeen can be easily shown. If a ¥ Yr and = (fees ateis 


false that the lim WU Ge s_) = Hh lie is We reason this 
n+ nm on 


= M ; 
aed cea ee) oe Is (Cen seis 


in the following manner: Since lim M 
nao 


CO 
Gemsay that U M 


nat = Haeeeey) we mean that for any 


1,(r, 58.) 


WE M) [r,s]? we have that w eM LOVESGmne: he Vert 


1,(r,58,) 


we choose weM NM 


Ora) 


M e 
1,{r,s}" 0,(s,t.]° then certainly 


we My ry gj but o ¢ M (rs, foreseen, o This: 
er. Ss) i My Cr,s]° However, from (11) we have that, 
00 ee 
8) it gS Ag and s, + S83 then 


lim P(M We term this third 


ls 


= P(M 


1(r,4s,)? Cosas 


Cemeecion our "continuity condition". 

Let us consider an example of an assignment of 
probabilities in a non-separable process, where the assign- 
meno 1S consistent with the three criteria we have established. 
ina a particular non-separable process we will make the 
assignment of probabilities to our 4-sets in the following 
manner: 

P(M 


1 Coney” she (r,s)eL0,t /2) 


P(M 


) = A | ° 
1,(r,s) = ISEBO 6 2. 
(P : @ 4 O PCM, (r,s)? ate (r,s)e(s-,t,) 


pale (25/70) P(M 5)) otherwise. 


C2? « 
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To those W/-sets in which the value is 0 throughout the 
interval, we use the same assignment of probabilities. It 

is easily verified that such an assignment is consistent 

with the three criteria. However, let us examine the process 
more, closely. We introduce the functions a, 8, and y 


defined -by, 


ens) )) = PM) (r,s)? 


—-log(a((r,s))) 


8((r,s)) 


cc) eee as) ). 


We observe that @((r,s)) = y(s) - y(r), and because of 


Che assignment of probabilities, our y function is more 


precisely defined by, 


S 
as ala oh pone 
Wks = F 
2(s-)1log(2) dc i oe = 
since P(M, Rs 5)? = eats-r) | where a is the value obtained 
2 3 


eeeene beginning of this chapter. The graph of the function 


leoks like: 
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y(b) 


Log(2)tat 


at /2 


tie 3 b 


Though this approach worked nicely for this example, the 
approach will fail when a particular assignment gives 
probability 0 to some Z[-set, say My oy: in which case B(I1) 
beoeevelue ©, and, hence, y is not finite. With y not 
freee COMsistency tests must be handled more delicately. 

ijetcenow OUP Interest to look for finer conditions, 
memmensshiall do so by looking at our assignments from a 
Gifferent vantage point. Noting that there is a relation- 
ship between the probabilities of a set and the probabilities 
of its subsets and supersets, we may think of the ratio of 
the separable probability over the non-separable probability 
of an M-set as a function of the endpoints of the #%-set's 
amiverval. This ratio is what we will call the factor 
function F(-,+), and write the probability of an W-set 
mmene following form: 


P(M = F(r,s) P(M 


1, (r,s)? 1,(r,8))° 


Now we wish to characterize the function F. One 


Sev2ous Coneition that F must satisfy is, 
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yO castes) <1. 
We obtain another condition by examining the relationship, 


F(r,s)P(M) (pn sy? = PCM) (r,s)? = PUM crt) 1 (es)? 


P(r ,t)P(M) (yy) PCE SIPCM (4 gy) 


P(r ,t)PCt,s)PCM, (gy PCM 4 sy? 


P(r, t)F(t,s)P(M, (2 5) 


P@emeer <« t < S. Thus, we have a second condition: 
Pm ens) = R(r. tjece.s) homme 1 < b< Ss), 


Since the interval (r,r) is actually the void set, we know 


Ghat P(M = P(?) = 1. So Firga = 2 for all r, and 


La Ce mee 


we may write condition (2') as 


peat Gens) =f Come ph Crs ) oie EDD ae 


JA 
ct 
JA 
on 


A third condition is derived from criterion (3) stated 


earlier; we have 


t = 
Born it r,‘rands, ts, then lim F(r_ 58) GORE) s 


n-o 
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An equivalent statement of (3') is 


3) F(r,s) is right continuous in r, and left 


continuous in s. 


The factor function of the example presented earlier can 
be shown to satisfy these three conditions. 

From conditions (1) and (2), we note that F is 
Memeincreasing for increasing s or for decreasing r. A 
subsequent result is that F is an upper-semicontinuous 
TUmetion, Which we will show. Choose c > 0, and consider 
the set {(r,s)|F(r,s)<c} =W. If (r,s) e W, there exists 
6 > 0 such that F(r+6,s-6) < c, by criterion (3). Since 
feeemmon—incereasing for increasing s or for decreasing r, 
miemem@orcnwest region of our domain with respect to the 
point (r+é,s-6) is contained in W. In particular there 
is an open area in this northwest region containing (r,s). 
Thus, W is open. .Therefore, F is an upper-semicontinuous 
function. 

Now let Y¢ = {F|F satisfies conditions (1), (2), 
and (3)}. Let F, be a decreasing sequence in f~. Since 
each Fa is bounded, the sequence converges to some F. We 
wish to show that F is also in ~. Since the sequence is 


bg! 7 Met Or seach nn, 


F (r,s) = F_(r,t) F_(t,s) one cull SO Rego 9S gir 
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WiGe.coewand that 


we know also that lim F (r,s) 
n> 


lim (F (r,t) F_(t,s)) rue ainieD Js ) . 


noo 


Hotei ,s) = P(r,t) F(t,s) for all r < t < s, so 
Penmart)on (2) is satisfied. For condition (3), let ry Yr, 


mien for all n, 
lim F (r,,s) = F (r,s). 
eee Ke ie ape 


Choose € > 0. For some n, |F—(r,s) =e.) AS = . Now 


there exists a k such that for all k > k? 


ener, 55) ~ Pare) | < = We note that 
aes) 2 Gens!) 2 Hrs) aks all k > k. 
Thus , [F(r, 4s) eo 555)))| S| eg ees Ges) 
S [ACerS = eens.) | + |F=(r,s) ~ F(r,s) | 


= €, foummemmetc > k(nGeep) = k(e). 


A 
hoym 
+ 
rym 


toemetore, lim F(r, 58) = F(r,s), likewise for s, and 
‘ko 


Bemdation (3) is satisfied: Obviously, condition (1) is 


satisfied, giving us the desired result that Fe #. A 
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meeemcer conjecture is that each function in # is the 
ime, Ol a decreasing sequence of continuous functions 
in #. It remains to be proved. 

We may picture the domain of the functions in +F 
Peepecris dering r—-s coordinate system, where r and s range 
itcem 0 to to: SEICe eco hon Meyer tess than r, the domain 
of each F is the triangular region bounded by the lines 


r= 0, s= toe and r= s. We illustrate: 


5 


ol ys \\y \ 


\ 


By the argument used earlier, F(r,r) = 1 for all r. Thus, 
the value of F along the line r = s is 1 for any assignment 
Sreprobabilities. 

Now suppose that fOr asparticular pair, P6255 > 
5.) = 0. Looking at our coordinate system, all points 
to the northwest of (r.>8)) have value 0 under the function 
F. By the same reasoning if F(r,s) > 0, then all points 


to the southeast of (r,s) have values greater than 0 under 


the function F. We alsoknow that since 
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Co 5) = Pe as) F(s.-658)) = 0, then either 
P(r 38,-9) = 0, or F(s.-6 58) = 0. 


fiom cnere €xists some point of value 0 under F along the 
Miemeeines which form the boundary of all the points to the 
southeast of (ro 58,)- Suppose it is the point (ro 25,-6). 

By condition (3), all points between Ges =6)) and Coney) 


ieee value O under ¥. Ii we add on an additional property 


taew for all E,2Ey ? 0, (0 aes -E5) > 0, we can argue 


2 1?°o0 
MeveiOr ¥ Such that 0 < y < 6, and all e > QO, 


BD 5S 3) CS oS a, = TCG Santen) = 0. 


since SEO e501 y) PUD yay pOLrnesis. F(rs8-6-€) = 0 
for all e > 0. Therefore with the added property, all 
points between (ro 58)) and Wie IIe | have value O under F. 
ies) -5,5,) is the point having value 0 under F, instead 
of (7035-8); the ane arguments would hold for the points 
between ee) and (S$. 38))- 

Consider the following set of points along a path, A, 
in the domain of FF. From this path we form the regions 
foes ond 2. if we specify arbitrary positive values to 
miiepOoinkgs On path A, and if these values are consistent 
with the three conditions of F, then we may argue that all 


points in the regions X, Y, and Z have values determined 


oe, 








Pyare Values along the path A. For example, consider a 


point, (r,s), in the region X. We have that 
F(u,;8) = F(u,,Pr) Bagi cols bye comedtiom (2). 


Since we have specified the values for F(u,;8) and F(u,>,r); 
F(r,s) is forced to assume a particular value. We may use 
the same argument for all points along the northern border 
of X, which is a pee ieion Of the Neri zontal Line am 
path A. Thus , all points between Cu, »V,) and (v4 2V,) have 
a specified value, and, hence, we may determine the values 
in the region Y in the same manner as we did in the region 
X. Now we have values for all points between (uy »V5) and 
(u,;,u,), and, therefore, we may determine the values in 

the region Z. From this result we conclude that it is 


magiicient to define our function F only alone <a) Daath such 


aS 
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ooweinm order Co define the function in the smallest 
Seuvheast region containing the path. 
fren Ghis development Gig vac seUnegionm i. we conclude 


our work with a series of results. 


Lemma 1: If F(r,s) > 0, then 
imi (re) isecontanuous on [r,s | 


and, emo Gems) 1S Comernuens on Ilr. s | 


Proot: For i) we know that for s e [r,s], 


mer ,s—-6) = K(r,s). Since F(sté,s) > 0 for all 6 > 0, 
6+0 


and since the lim F(sté,s) = F(s,s) > 0 
6>0 


lim F(r,sté6) = lim (F(r,s)/F(st6,s)) = F(r,s). 
60 6 +0 


ites) is true, and similarly, ii) is true. _ 
since F is continuous along the line r = s, by 
Lemma 1, F is continuous on all che peoun@dary or a triangular 


meeeom in the domain of F. Thus, 


Lemma 2: If F(r,s) > 0, then F is continuous on 


the closed, southeastern region of the point (r,s). 


The lemma follows since the boundary values determine 


the interior values. 
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ineouen:- ath time E(r,s) > 0, then lim F(r,s) = F(r_,s_). 
iat eae ne 


Ss°?s s°*s 
‘e) O 


Proof: If lim F(r,s) > 0, then there is a neighbor- 
Gai 
O 


S7S | 
hood about ee) such that F is positive in this region. 
itmeparticular, F is positive at some point in the neighbor- 
hood which is northwest of (r0>8.)- Thus, by Lemma 2, F 


is continuous at the point (r.,s_). 


Conolary: ~The lim Gee) eigulotoie: Metepoyehiis, 10) toe Ji 
7 = n> hy al 
dt il 
Proof: If for some N, Fla-—,a+—) > 0, then by 
Lemma 2, F is continuous at (a,a). Thus 
7 


Lai F(a-=,at=) = F(a,a) = 1. If no such N exists, then 
Mo 


momeatl n, as) = 0. Thus, lim cae wat) = Q, pal 
eae “Hes n n 


and the corollary is proved. 


SOrgwlory. she probability of the event 


Leal es 1} is either 0 or P(x, = 1). That is to say, 
s>t : 


the sample paths passing through 1 at time t are either 


famoset all continuous or almost all discontinuous. 
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Eroorm: Consider the—set a and 


= M iL 1 
alte (Dee Ra, ; 


meee = UW ©. The event @ is not the same as the event 


(x, = 1}. But from the previous corollary, P(Q) = P(x, = 1), 


unless the Q's are null sets, in which case P(Q) = 0. 
n 
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CONCLUSION 


In the non-separable process we have reduced the 
probability of some (or all) of our W%-sets with respect to 
its separable probability. Since the probability of an 
Wi-set cannot be greater than its separable probability, 
an interesting question is which events in the non-separable 
Process have their probabilities increased when the 
probability of an #-set is decreased. We do know that 
muemmeyentvs belong to the class of sets in which an 
"infinite number of transitions" have taken place over an 
interval. However, such events have separable probability 
Omeoince the factor function F - approach seemed to answer 
many vague ideas about non-separability, perhaps with a 
mimerer characterization of F, such questions as that 


mentioned above may be answered. 
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